Light-Weight Parallel I/O Analysis at Scale

نویسندگان

  • Steven A. Wright
  • Simon D. Hammond
  • Simon J. Pennycook
  • Stephen A. Jarvis
چکیده

Input/output (I/O) operations can represent a significant proportion of the run-time when large scientific applications are run in parallel. Although there have been advances in the form of file-format libraries, file system design and I/O hardware, a growing divergence exists between the performance of parallel file systems and compute processing rates. In this paper we utilise RIOT, an input/output tracing toolkit being developed at the University of Warwick, to assess the performance of three standard industry I/O benchmarks and mini-applications. We present a case study demonstrating the tracing and analysis capabilities of RIOT at scale, using MPI-IO, Parallel HDF-5 and MPI-IO augmented with the Parallel Log-structured File System (PLFS) middle-ware being developed by the Los Alamos National Laboratory.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sol-gel synthesis, characterization, optical properties and catalytic performance of Y2Ce2O7 nanomaterial

Y2Ce2O7 nano powders were synthesized via sol-gel reactions at 900 (S1), 1000 (S2) and 1100 (S3) ˚C for 4 h using yttrium acetate (C6H9O6Y.xH2O), ammonium cerium nitrate ((NH4)2Ce(NO3)6) and stearic acid (C18H36O2</s...

متن کامل

Sol-gel synthesis, characterization, optical properties and catalytic performance of Y2Ce2O7 nanomaterial

Y2Ce2O7 nano powders were synthesized via sol-gel reactions at 900 (S1), 1000 (S2) and 1100 (S3) ˚C for 4 h using yttrium acetate (C6H9O6Y.xH2O), ammonium cerium nitrate ((NH4)2Ce(NO3)6) and stearic acid (C18H36O2</s...

متن کامل

A Comparison of GSIFTP and RFIO on a WAN

RFIO (Remote File I/O) is one of the components that make up the CERN Advanced Storage Manager (CASTOR) [1]. RFIO implements a remote version of most standard POSIX calls like open, read, write, lseek and close using a very light weight protocol. The control and data streams are separated. To optimize the data throughput by overlapping network and disk I/O, a circular buffer and two threads are...

متن کامل

Solid state synthesis of MgAl2O4 nanomaterials and solar light-induced photocatalytic removal of Malachite Green

Spinel MgAl2O4  nanopowders were synthesized by one-step solid state reactions using Al(NO3)3.9H2O and MgSO4 raw materials at stoichiometric 1 : 2, Mg : Al molar ratio at a constant reaction temperature of 1000 ºC for 8 h (S1), 10 h (S2) and  24 h (S3). The synthesized materials were characterized...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011